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(54) Hierarchical bandwidth management in multiservice networks 



(57) A hierarchical bandwidth management model 
for multiservice networks that provide management at 
a transport level and at a service/application level to pro- 
vide increased network scalability without sacrificing 
bandwidth management efficiency and flexibility. In par- 
ticular, in an Multiprotocol Label Switching (MPLS) en- 
vironment, a method of hierarchical bandwidth manage- 
ment in a multiservice network supporting various qual- 
ity of service levels (e.g. EF, AF1, AF2, BE) and a 
number of applications (e.g. ATM, MPLS, IP, FR) is dis- 
closed. The method includes the steps of: establishing 
a transport connection tunnel (e.g. an E-Label Switched 



Path(LSP)) between pairs of the edge nodes in the net- 
work; and managing bandwidth of the transport connec- 
tion tunnel among the quality of service levels and the 
applications. In an exemplary embodiment the invention 
also provides a hierarchical admission structure: one at 
a transport level for the label switched paths and one at 
a service level for user/application connections. The hi- 
erachical bandwidth management model (exemplified in 
a method and an apparatus) provides the ability to share 
and/or partition bandwidth by application and quality of 
service and the ability of customer-controlled trade-off 
of bandwidth guarantee (per application/QoS) and net- 
work efficiency (i.e. low fragmentation). 




FIG. 1B 
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Description 

FIELD OF THE INVENTION 

[0001] The present invention relates generally to mul- 
tiservice networks, and more particularly to a method 
and system to provide bandwidth management within 
multiservice networks. 

BACKGROUND OF THE INVENTION 
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[0002] Fig. 1 A illustrates key components of a multi- 
service network 10 having a core network 12 that in- 
cludes a plurality of core nodes 14 (i.e. service provider 
backbone or provider core nodes) interconnected with ?5 
core links 16. An access network 18 that includes a plu- 
rality of edge nodes 20 (i.e. service provider edge or pro- 
vider edge nodes) provide access to the core network 
12 through the links 16 for a plurality of access nodes 
23 and/orfora plurality of customer premise edge (CPE) 20 
nodes 24. 

[0003] The CPE nodes 24 originate user connections, 
such as ATM, FR, voice or MPLS service requests. The 
access nodes 23 optionally lie between the CPEs 24 
and the edge nodes 20. The access nodes 23 do not 25 
perform aggregation (i.e. individual user connections 
are all visible). The access nodes 23 run the service pro- 
tocols (e.g. ATM P-NNI, FR routing) and generally use 
single-level bandwidth management. 
[0004] The edge nodes 20 (also called edge switch/ 30 
routers) perform the interworking function/adaptation 
between the access 1 8 and the core 1 2. The edge nodes 
20 fully participate in the access network 18 similar to 
the access nodes 23 discussed above and fully partici- 
pate in the core transport 12. The edge nodes 20 also 35 
perform the aggregation of access/user connections in- 
to transport tunnels across the core 12. 
[0005] The core nodes 14 (also called core routers or 
MPLS core routers) have no visibility of individual user 
connections or applications (i.e. pure IP/MPLS routers). <o 
The core nodes 14 are connected to the edge nodes 20 
and among themselves with the core links 16 and per- 
form single-level bandwidth management (namely, 
Transport Bandwidth Management), which manages 
the bandwidth of the underlying physical links between 45 
the various transport tunnels. The core and edge nodes 
14, 20 participate in the core routing and maintain the 
same core topology database. 
[0006] Prior art models use a flat network architec- 
ture, which makes no distinction between the access 1 8 50 
and core 12 networks. Each CPE node 24 connection 
is mapped to a corresponding Multiprotocol Label 
Switching (MPLS) Label Switched Path (LSP) connec- 
tion at the access/edge 23, 20 node. Compared to tra- 
ditional pure IP connectionless networks, the use of 55 
MPLS has been proposed to provide the capabilities of 
traffic engineering with constraint-based routing, alter- 
nate paths for redundancy, and load distribution. Anoth- 



er motivation for using MPLS is to provide connections 
with different characteristics to support a range of serv- 
ices and quality of service (QoS) levels. 
[0007] Although these solutions improve scalability 
somewhat, a large number of LSP connections in the 
network 10 are required. This is not scalable because 
the core nodes 14 are required to maintain context and 
signaling support for a very large number of individual 
user connections/flows (i.e. between the CPEs 24) shar- 
ing the network 10. The increased number of LSP net- 
work connections introduces further disadvantages 
such as operations complexity, slow failure recovery, 
and increased network control overhead. 
[0008] Consequently, there is a need for a method 
and system for managing bandwidth in multiservice net- 
works (supporting for example ATM, FR, IP, MPLS, cir- 
cuit emulation) that minimizes operations complexity, 
speeds up failure recovery, and minimized network con- 
trol overhead. 

SUMMARY OF THE INVENTION 

[0009] The present invention provides a hierarchical 
bandwidth management model for multiservice net- 
works that creates one or more aggregate tunnels for 
carrying user traffic between edge nodes in a multiserv- 
ice network. In an exemplary embodiment the invention 
also provides a hierarchical admission structure: one at 
a transport level for the label switched paths and one at 
a service level for user/application connections. 
[0010] In accordance with one aspect of the present 
invention there is provided a method of hierarchical 
bandwidth management in a multiservice network sup- 
porting a plurality of quality of service levels and a plu- 
rality of applications, the multiservice network includes 
a core, a plurality of access nodes and a plurality of edge 
nodes having connectivity with each other through the 
core, the method comprising the steps of: (a) establish- 
ing a plurality of transport connection tunnels between 
pairs of the edge nodes in the network; and (b) manag- 
ing bandwidth of the transport connection tunnels 
among the plurality of quality of service levels and the 
plurality of applications. 

[0011] In an exemplary embodiment step (a) above 
includes the steps of: (a1) establishing at least one 
transport pool; (a2) assigning the plurality of quality of 
service levels to the least one transport pool; and (a3) 
assigning at least one transport pool to the plurality of 
transport connections. 

[0012] In an exemplary embodiment step (b) above 
includes the steps of: (b1) establishing at least one ap- 
plication pool; and (b2) assigning the plurality of appli- 
cations to the least one application pool. 
[0013] In accordance with another aspect of the 
present invention there is provided a method of hierar- 
chical bandwidth management in a multiservice network 
supporting a plurality of quality of service levels and a 
plurality of applications, said multiservice network hav- 
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ing a core, a plurality of access nodes and a plurality of 
edge nodes having connectivity with each other through 
the core, said method comprising the steps of: (a) es- 
tablishing a transport connection tunnel between pairs 
of the edge nodes in the network; and (b) managing 
bandwidth of the transport connection tunnel among the 
plurality of quality of service levels and the plurality of 
applications. 

[0014] In accordance with another aspect of the 
present invention there is provided an apparatus for hi- 
erarchical bandwidth management in a multiservice net- 
work supporting a plurality of quality of service levels 
and a plurality of applications, said multiservice network 
having a core, a plurality of access nodes and a plurality 
of edge nodes having connectivity with each other 
through the core, said apparatus comprising: (a) a trans- 
port bandwidth management (TBM) module for estab- 
lishing a transport connection tunnel between pairs of 
the edge nodes in the network; and (b) a service band- 
width management (SBM) module communicatively 
coupled to the TBM module for managing bandwidth of 
the transport connection tunnel among the plurality of 
quality of service levels and the plurality of applications. 
[001 5] In an exemplary embodiment, the TBM module 
includes: a module for establishing and managing a 
transport pool; a module for assigning the plurality of 
quality of service levels to the transport pool; and a mod- 
ule for assigning the transport connection tunnel to the 
transport pool. 

[001 6] In an exemplary embodiment, the SBM mod- 
ule includes: a module for establishing and managing a 
plurality of application pools; a module for assigning the 
plurality of applications at the plurality of quality of serv- 
ice levels to each of the plurality of application pools; 
and a module for assigning the application connection 
to the plurality of application pools. 
[0017] In accordance with another aspect of the 
present invention there is provided a computer program 
product for hierarchical bandwidth management in a 
multiservice network supporting a plurality of service 
categories and a plurality of applications, said multiserv- 
ice network having a core, a plurality of access nodes 
and a plurality of edge nodes having connectivity with 
each other through the core, said computer program 
product comprising: (a) a computer readable medium; 
(b) a transport bandwidth management (TBM) module 
for establishing a transport connection tunnel between 
pairs of the edge nodes in the network; and (c) a service 
bandwidth management (SBM) module communicative- 
ly coupled to the TBM module for managing bandwidth 
of the transport connection tunnel among the plurality of 
quality of service levels and the plurality of applications. 
[0018] In accordance with another aspect of the 
present invention there is provided a method of hierar- 
chical bandwidth management in a multiservice network 
supporting a plurality of quality of service levels and a 
plurality of applications, said multiservice network hav- 
ing a core, a plurality of access nodes and a plurality of 



edge nodes for establishing user connections, said 
edge nodes having connectivity with each other through 
the core, said method comprising the steps of: (a) es- 
tablishing a plurality of transport connection tunnels be- 

5 tween pairs of the edge nodes in the network at a trans- 
port layer; (b) managing bandwidth of the transport con- 
nection tunnels at an application layer; (c) controlling ad- 
mission of the plurality of transport connection tunnels 
at the transport layer; and (d) controlling admission of 

10 the user connections belonging to the plurality of appli- 
cations at the plurality of quality of service levels. 
[0019] Other aspects and features of the present in- 
vention will become apparent to those ordinarily skilled 
in the art upon review of the following description of spe- 

15 crfic embodiments of the invention in conjunction with 
the accompanying figures. 

BRIEF DESCRIPTION OF THE DRAWINGS 

20 [0020] Further features and advantages of the 
present invention will be described in the detailed de- 
scription, taken in combination with the appended draw- 
ings, in which: 

25 Fig. 1 A illustrates a general representation of a mul- 
tiservice network supporting according to the 
present invention; 

Fig. 1B illustrates a general logical representation 
of the core network as viewed by the access net- 

30 work of Fig. 1A supporting MPLS tunnels; 

Fig. 2 illustrates a functional block diagram of a hi- 
erarchical bandwidth management system accord- 
ing to an embodiment of the present invention; 
Fig. 3 illustrates a schematic representation of var- 

35 ious transport pool partitioning arrangements as 
part of the transport bandwidth management mod- 
ule shown in Fig. 1 ; 

Fig. 4 illustrates a schematic representation of var- 
ious application pool partitioning arrangements as 
<o part of the service bandwidth management module 
shown in Fig. 1; 

Fig. 5 illustrates the interface between an applica- 
tion layer and the service bandwidth management 
module of Fig. 4 in the edge node; 

45 Fig. 6 illustrates a functional block diagram of a hi- 
erarchical bandwidth management system accord- 
ing to another embodiment of the present invention; 
Figs. 7A and 7B illustrates several examples of hi- 
erarchical bandwidth management using the Multi- 

50 protocol Label Switching (MPLS) model with 
E-LSP; 

Figs. 8A and 8B illustrate functional diagrams of the 
distributed connection admission control of hierar- 
chical bandwidth management of the present inven- 
55 tion; and 

Fig. 9 illustrates a block diagram of a hierarchical 
bandwidth management apparatus exemplified in a 
switching environment. 
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DETAILED DESCRIPTION OF EMBODIMENTS OF 
THE PRESENT INVENTION 

[0021] To provide a proper basis of terminology the 
following standards are used: 5 

(a) the terms application and service are used syn- 
onymously to refer to, for example: Asynchronous 
Transfer Mode (ATM); Frame Relay (FR); Multipro- 
tocol Label Switching (MPLS); and Internet Protocol 10 
(IP); 

(b) tunnel refers to the aggregate/transport LSPs 
across the core 12 (i.e. they originate and terminate 
on the edge nodes 20) The core nodes 14 view them 
as regular LSP connections; 15 

(c) IP-DiffServ (Differentiated Services) Quality of 
Service (QoS) terminology is used when discussing 
transport bandwidth management (e.g. Expedited 
Forwarding (EF); Assured Forwarding levels 1 and 
2 (AF1 , AF2); and Best Effort (BE).); and 20 

(d) ATM Quality of Service (QoS) terminology (e.g. 
Constant Bit Rate (CBR); Real-Time Variable Bit 
Rate (VBR-rt); Non-Real-Time Variable Bit Rate 
(VBR-nrt); and Unspecified Bit Rate (UBR).) when 
discussing service bandwidth management. Items 25 
(c) and (d) are merely examples as some services 
such as IP or MPLS may use IP terms and FR may 
use other terminology. 

[0022] In general, referring to Fig. 1B, hierarchical 30 
bandwidth management according to the present inven- 
tion involves the creation of one or more aggregate tun- 
nels in the core 12 of the network 10 for carrying user 
traffic between edge nodes 20. 

[0023] In particular, hierarchical bandwidth manage- 35 
ment according to the present invention involves, refer- 
ring to Figs. 1Aand 1B, managing bandwidth in the core 
network 12 at two levels. The first level is at a transport 
layer, which manages the links 16 in the core network 
12 between edge nodes 20. The second level is at a 40 
service layer, which manages bandwidth of the tunnels 
established at the transport layer. 
[0024] Typically, the bandwidth in each tunnel is used 
by numerous services/applications with various band- 
width and QoS requirements. At the second level in the 45 
hierarchical management, a number of application 
pools are established within each tunnel and each serv- 
ice/applications is assigned to one of the application 
pools. The application pools are then used for admission 
control of individual connections originated by the CPE so 
nodes 24 and/or by the access nodes 23. The applica- 
tion pools can be flexibly configured to provide full, par- 
tial partitioning or hybrid sharing of bandwidth among 
various services or applications at various QoS levels 
using the tunnel. The present invention also provides 55 
flexible and service-aware overbooking of network re- 
sources, and for preemption of lower-priority connec- 
tions by higher priority ones under failure or resource 



shortage scenarios. 

[0025] The detailed description of the present inven- 
tion will continue using the Multiprotocol Label Switching 
(MPLS) model to provide a consistency in terminology 
and logic. However, the hierarchical management mod- 
el of the present invention applies equally to other net- 
work models as will be readily apparent to those skilled 
in the art. 

[0026] By way of background, one use of MPLS is to 
create topology-driven paths through a network. These 
paths allow IP traffic (for example) between different 
nodes in the network to be routed only at the ingress 
edge of the MPLS domain. After the first node, the data 
is then forwarded based purely on the attached label, 
rather than a routing analysis performed on the IP head- 
er. If this label is encoded into the header of various Lay- 
er 2 forwarding technologies such as ATM and frame 
relay, these switches then can participate in the network 
packet forwarding using the MPLS label. 
[0027] With topology-driven MPLS, Label Switch 
Paths (LSPs) are created between pairs of nodes in the 
network. Hence, the LSPs are established according to 
the network node topology. The LSPs are initiated 
based on the routing information within the nodes; there- 
fore, the path to the destination address will be the same 
for the LSP as for routed packets. If the network consists 
of switch/router nodes at the edge and a core of MPLS 
core routers, then MPLS LSPs are established between 
each pair of switch/routers at the edge through the 
MPLS core routers. These paths then create direct con- 
nections between the edge routers. 
[0028] Besides creating paths for traffic according to 
the network topology, MPLS also can be used to create 
LSPs throughout the network for specific purposes. 
Each LSP created through the network is established 
by signaling. This signaling carries information about the 
required characteristics for the LSP. Since each node in 
the network must ensure that its part of the connection 
meets those requirements, it is possible to ensure that 
the entire LSP also meets the requirements. The re- 
quirement characteristics of an LSP typically include: 
bandwidth (including sustained and peak data rates and 
maximum burst sizes), delay and delay variation; and 
path selection. 

[0029] The path through the network created by 
MPLS can be controlled using the path selection capa- 
bility of explicit routing, which is well known to those 
skilled in the art. With explicit routing the path does not 
need to follow the normal routing path for that destina- 
tion. Instead, the path to be taken by the LSP is specified 
in the signaling. 

[0030] In summary, MPLS creates paths through a 
network, and data on these paths is not routed at each 
nodes, MPLS effectively creates "tunnels" or transport 
connections through the network. These tunnels have 
a well-defined entrance, a well-defined exit, and a gate 
to control what is allowed into the tunnel. Once in the 
tunnel, there are no branch exits since the data is not 
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routed at intermediate nodes. 

[0031] Further, the present description refers to 
L-LSPs and E-LSPs. An L-LSP can only carry a single 
quality of service. An E-LSP can carry multiple QoS 
packets. The E-LSP MPLS Exp Bits in each packet 
header enables the routers to determine the QoS treat- 
ment for each individual packet. 
[0032] Fig. 2 illustrates a functional block diagram of 
a hierarchical bandwidth management system 100 ac- 
cording to an embodiment of the present invention. The 
system 100 includes a transport bandwidth manage- 
ment (TBM) module 102 and a service bandwidth man- 
agement (SBM) module 104. 

[0033] The transport bandwidth management (TBM) 
module 102 establishes at least one transport pool 106 
for sharing and partitioning by quality of service (QoS). 
Examples of QoS in an MPLS environment are: Expe- 
dited Forwarding (EF); Assured Forwarding levels 1 and 
2 (AF1 , AF2); and Best Effort (BE). 
[0034] The TBM module 102 functions as follows: 

(a) core links 16 in the MPLS core 12 (see Fig. 1) 
are partitioned with a percentile value assigned to 
each transport pool 106. Fig. 3 illustrates three al- 
ternative transport pool 106 configurations: (i) fully 
shared 106A where only pool is configured at 1.0 
Link Rate (L); (ii) partitioned 106B where four pools 
are configured; or (iii) hybrid 106C with a combina- 
tion of partitioned and shared where two pools are 
configured; 

(b) map the various QoS levels (EF, AF1.AF2, BE) 
to an appropriate transport pool established in step 
(a). Fig. 3 illustrates the mapping between QoS and 
the transport pools 106 in three different configura- 
tions: (i) fully shared 106A (1.0 Link Rate (L)) in 
which EF, AF1, AF2 and BE share the same pool; 
(ii) partitioned 1 06B with each QoS (EF at 0. 1 L, AF1 
at 0.3L, AF2 at 0.4L and BE at 0.2L) mapped to dif- 
ferent pools; or (iii) hybrid 106C with a combination 
of partitioned and shared (EF and AF1 at 0.3L in 
one pool and with AF2 and BE at 0.7L combined in 
another pool); and 

(c) map each respective LSP to an appropriate 
transport pool 106 based on its QoS. Examples of 
MPLS Label Switch Paths (LSPs) QoS are: Expe- 
dited Forwarding (EF) 108; Assured Forwarding 
levels 1 and 2 (AF1, AF2) 110, 112; and Best Effort 
(BE) 114. The MPLS LSPs (108-114) are estab- 
lished using standard MPLS LSP signaling proto- 
col. 

[0035] Steps (b) and (c) is protocol specific since each 
MPLS protocol (e.g. CR-LDP {Constraint Based Routed 
Label Distribution Protocol}, RSVP {Resource Reserva- 
tion Protocol} and MPLS with Diffserv {differentiated 
Services} support) has its own set of QoS. 
[0036] The service bandwidth management (SBM) 
module 104 establishes at least one application pool 



116 for sharing among all applications with up to 16 ap- 
plication pools for partitioning by application and QoS. 
Examples of application categories in a multiservice net- 
work environment are: Asynchronous Transfer Mode 
5 (ATM); Frame Relay (FR); Multiprotocol Label Switching 
(MPLS); and Internet Protocol (IP). 
[0037] The application pools 116 are provisioned as 
follows: 

10 (a) each of the transport LSPs 108, 110, 112, 114 
bandwidth is partitioned, with a percentile value as- 
signed to each of a plurality applications. Fig. 4 il- 
lustrates three alternative application pool 1 1 6 con- 
figurations: (i) fully shared 116A where only one 

is pool is configured; (ii) partitioned 116B where four 
pools are configured; or (iii) hybrid 1 1 6C with a com- 
bination of partitioned and shared where two pools 
are configured; and 

(b) assign the applications (ATM, FR, MPLS, IP) to 
20 one of the application pools 116A-C partitioned in 
step (a). Fig. 4 illustrates three alternative applica- 
tion pool 116 configurations: (i) fully shared 116A 
(100%) in which ATM, FR, MPLS and IP share the 
same pool; (ii) partitioned 116B with each applica- 
25 tion (ATM at 20%, FR at 30%, MPLS at 30% and IP 
at 20%) mapped to different pools; or (iii) hybrid 
116C with a combination of partitioned and shared 
(ATM and FR at 30% in one pool and with MPLS 
and IP at 70% combined in another pool). 

30 

[0038] As described above, one or more applications 
can be assigned to the same application pool (e.g. pool 
116Aand pools 116C). For simplicity in the drawing (Fig. 
2), only one mapping is shown: FR at VBR-rt 118; ATM 

35 at VBR-rt 120; IP at VBR-rt 122; and MPLS at VBR-rt 
124 are mapped to AF1-LSP 110, where CBR is Con- 
stant Bit Rate; VBR-rt is Real-Time Variable Bit Rate; 
VBR-nrt is Non-Real-Tlme Variable Bit Rate; and UBR 
is Unspecified Bit Rate. 

40 [0039] A connection level management (CLM) mod- 
ule 130 for connection admission control (CAC) is pro- 
vided to control the admission of the application connec- 
tion based on its QoS and the corresponding application 
pool 116: an FR connection 132 with VBR-rt QoS to the 

45 FR (VBR-rt) 118; an ATM connection 134 to the ATM 
(VBR-rt) 120; an IP connection 136 to the IP (VBR-rt) 
122 and an MPLS connection 138 to the MPLS (VBR- 
rt) 124. Similar mappings are established for the EF LSP 
108, AF2 LSP 112 and BE LSP 114 transport connec- 

50 tions. Details of admission control are discussed here- 
inbelow in conjunction with Figs. 8A and 8B. 
[0040] The SBM module 104 also reports to the ac- 
cess nodes 23 any significant changes in bandwidth as 
in the case of PNNI (Private Network-to-Network Inter- 

55 face) routing, where a significant change in tunnel band- 
width is flooded throughout the network 10. For exam- 
ple, the SBM module 104 detects the significant change 
and notifies ATM access switches 23 (as an example), 
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which will inform PNNI networking application of the 
change. Since a particular LSP can carry more than one 
application (i.e. ATM shares bandwidth with other appli- 
cations), PNNI updates are triggered not only by ATM 
traffic, but also by traffic from other applications. 5 
[0041] Fig. 5 illustrates a functional representation of 
bandwidth reservation as discussed above. In particu- 
lar, the following process is used to interface between 
the SBM 104 and an application layer 138 in one of the 
edge nodes 20: (A) the SBM 1 04 advises the application 10 
layer 138 of significant bandwidth changes in the appli- 
cation pools 116 with signal at step 140; (B) the SBM 
104 advises the application layer 138 of an asynchro- 
nous bumping request at step 142; (C) the application 
layer 138 advises the SBM 104 of a release signal at 15 
step 144 when connection is released; (D) the applica- 
tion layer 138 advises the SBM 104 of a request signal 
at step 146 when application bandwidth is required; (E) 
the SBM 104 advises the application layer 1 38 of an ac- 
cept, reject or accept with bumping signal at step 148 20 
when a decision is made regarding request (D); and (F) 
the SMB 104 and the application layer 138 communi- 
cate a query signal 150 regarding application pool 116 
allocations. 

[0042] The SBM 104 can support up to eight preemp- 25 
tion priorities where each application connection is as- 
signed to one these preemption priorities. The applica- 
tion connection with the highest priorities can preempt 
any of the connections with a lower priority. Therefore, 
the SBM 104 supports bumping between applications. 30 
For example, the SBM 104 can be configured to allow 
the ATM connection 134 to bump the frame relay con- 
nection 132. 

[0043] Fig. 6 illustrates a functional block diagram of 
a hierarchical bandwidth management system 200 ac- 35 
cording to another embodiment of the present invention. 
The system 200 includes the same key modules as sys- 
tem 100 shown in Fig. 2, in particular, the transport 
bandwidth management (TBM) module 102, the service 
bandwidth management (SBM) module 104; and the 40 
connection level management (CLM) module 130. The 
fundamental difference between the two systems 100 
(Fig. 2) and 200 (Fig. 6) is based on the type of Label 
Switch Path used. In system 100 an "L'-LSP is used in 
which multiple pairs of LSPs are established between 45 
edge nodes 20. In system 200 and W E"-LSP is used in 
which a single pair of LSPs is established between edge 
nodes 20. An L-LSP is characterized by a single QoS 
treatment for all the packets, whereas an E-LSP is char- 
acterized by multiple QoS treatment for its packets so 
based on the setting of experimental bits in an MPLS 
header. 

[0044] In system 200, an E-LSP 115 is established 
and mapped to a single transport pool 106A, which han- 
dles all QoS levels. The single tunnel E-LSP 115 band- 55 
width is managed by the SBM 104 in the same manner 
as discussed above in conjunction with system 1 00. Fig. 
6 illustrates four alternative application/service pools 



200. The application/service pools 200 are classified by 
QoS or by application type or a combination of the two 
as discussed below. 

[0045] The SBM module 104 can enable full sharing 
where all applications and QoS levels are shared in a 
single pool 200A. The CLM module 130 maps connec- 
tion 21 OA to the pool 200A. The SBM module 104 can 
enable partitioning by QoS where four QoS levels (CBR, 
VBR-rt, VBR-nrt, UBR) are partitioned into four pools 
200B1-4. The CLM module 130 maps connections 
210B1-210B4 to the pool 200B. The SBM module 104 
can enable partitioning by application where four appli- 
cations (ATM, FR, MPLS, IP) are mapped into four dif- 
ferent pools 200C1^. The CLM module 130 maps con- 
nections 210C1-210C4 to the pool 200C. 
[0046] The SBM module 1 04 can also enable full par- 
titioning by QoS and application where each QoS (CBR, 
VBR-rt, VBR-nrt, UBR) are assigned separate applica- 
tions (ATM, FR, MPLS, IP) to form a QoS vs. application 
matrix 200 D. Each connection of specific QoS and ap- 
plication 210D1-210D16 is mapped through the CLM 
module 130 to the pools matrix 200D. 
[0047] In summary, the service bandwidth manage- 
ment (SBM) module 104 involves partitioning tunnel 
bandwidth by application and/or QoS. For a single QoS 
tunnel (e.g. MPLS L-LSP-Fig. 2) the available band- 
width in the tunnel is partitioned by application. For a 
multiple QoS tunnel (e.g. MPLS E-LSP-Fig. 6) the avail- 
able bandwidth in the tunnel is partitioned by application 
and/or QoS. The SBM module 104 is managed at one 
of the ingress edge nodes 20 for managing bandwidth 
between various applications and QoS sharing the 
same LSP. 

[0048] Figs. 7A and 7B illustrates several examples 
of hierarchical bandwidth management using the Multi- 
protocol Label Switching (MPLS) model with and E-LSP 
tunnel. Example A illustrates one transport/application 
pool (P1 1 =1 00%) for all QoS levels (CBR, VBR-rt, VBR- 
nrt, UBR) and all applications (ATM, FR, MPLS, IP) for 
the single E-LSP tunnel 115. Example B illustrates four 
QoS pools with mixed applications for the E-LSP tunnel 
115. In particular, P11 (CBR.ATM/FR/MPLS/IP) is as- 
signed 25% of bandwidth for the E-LSP tunnel 115 and 
P12(VBR-rt,ATM/FR/MPLS/IP) is assigned 25% of 
bandwidth for tunnel the E-LSP tunnel 115. Similar pools 
are established for the VBR-rt and UBR as shown in Ex- 
ample B of Fig. 7A. 

[0049] Example C illustrates four applications pools 
with mixed QoS levels for the E-LSP tunnel 115. In par- 
ticular, P11 (ATM.CBR/VBR-nWBR-nrt/UBR) is as- 
signed 25% of bandwidth for the E-LSP tunnel 115 and 
P12(FR, CBRA/BR-rWBR-nrt/UBR) is assigned 40% of 
bandwidth. Similar pools P13 at 10% and P14 at 25% 
are established as shown in Example C. Example D 
(Fig. 7B) illustrates 16 pools separated by QoS and ap- 
plication for the E-LSP tunnel 115. For example, P22 
(VBR-rt, MPLS) is assigned 10% of bandwidth on the 
E-LSP tunnel 115. 
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[0050] Figs. 8A and 8B illustrate functional diagrams 
of the distributed connection admission control and 
overbooking features of hierarchical bandwidth man- 
agement of the present invention. A task of the CLM 
module 130 is to determine whether a requested band- 
width and QoS for a new connection can be supported. 
Two levels of admission control are used. A transport 
level CAC 300 (Fig. 8A), which controls the admission 
of transport LSPs (108-114, 115) and an application lev- 
el CAC 350 (Fig. 8B) to control the admission of appli- 
cations over a specific LSP 108-114, 115. 
[0051] From the bandwidth perspective the transport 
CAC 300 involves three steps: 

(1 ) calculate equivalent bandwidth (EBW) from traf- 
fic descriptor parameters Equation 1 is an example 
of an algorithm used to calculate LSP's equivalent 
bandwidth. 

EBW = 2*CDR*PDR/(CDR+PDR) Eq. 1 

where CDR and PDR are committed data rate 
and peak data rate respectively 

(2) normalize the EBW into common units (bytes/ 
sec), apply an appropriate scaling factor and over- 
head factor as is well known to those skilled in the 
art. The output to this step is Normalized Effective 
Bandwidth (NEBW) - i.e. the T-LSP bandwidth is es- 
tablished at edge nodes 20 and core nodes 14. 

(3) determine whether the requested bandwidth is 
available on every link 16 in the selected path (de- 
termined by constraint based routing in the core 12) 
or not and hence the connection is accepted or re- 
jected. 

[0052] Steps (1 ) and (2) are implemented in an MPLS 
transport layer 302 and step (3) is implemented in the 
TBM 102. The TBM module 102 also receives resource 
information from the core link resource module 306. 
[0053] Referring to Fig. 8A, the MPLS transport layer 
302 receives transport LSP setup requests and converts 
protocol specific parameters into effective bandwidth 
(EBW). The EBW is normalized to generate NEBW and 
passed to the TBM 1 02. The TBM 1 02 checks the avail- 
ability of bandwidth in the corresponding transport pool, 
updates it and reports back the decision (accept/reject). 
[0054] Similar to the transport CAC 300 the applica- 
tion CAC 350 controls the admission of application con- 
nection. The application CAC 350 involves similar steps. 
An example for ATM service follows: 

(1) calculate EBW, for example for ATM VBR con- 
nection this step uses the known EGH algorithm to 
convert PCR, SCR, MBS into ECR. 

(2) calculate NEBW, for example an ATM connec- 
tion with EBW of 1 Mbps may require a reservation 
of 1.3 Mbps due to the MPLS overhead. In particu- 



lar, NEBW is application connection bandwidth es- 
tablished at the edge nodes 20. 
(3) check bandwidth availability. 

5 [0055] Steps (1) and (2) are implemented in the ap- 
plication layer 138 and step (3) is implemented in the 
SBM module 1 04 of the edge node 20. The SBM module 
104 receives tunnel resource information from a tunnel 
resource module 307. 

10 [0056] Referring to Fig. 8B, the application layer 1 38 
receive connection setup requests and convert applica- 
tion specific traffic descriptors into EBW and then con- 
vert to NEBW. The NEBW is passed to the SBM module 
1 04 which checks for availability of bandwidth in the cor- 

15 responding application pool, updates it and report back 
to the core nodes 14 with the result (accept/reject). 
[0057] Fig. 9 illustrates a block diagram of the com- 
ponents of a hierarchical bandwidth management appa- 
ratus 400 implemented in a switch (e.g. the edge node 

20 20). 

[0058] The apparatus 400 is implemented in the edge 
node 20 and is used for hierarchical bandwidth manage- 
ment in a multiservice network supporting a number of 
QoS (e.g. EF, AF1, AF2, BE) and a number of applica- 

25 tions (e.g. ATM, MPLS, IP, FR). The apparatus 400 in- 
cludes: (a) the transport bandwidth management (TBM) 
module 102 for establishing a transport connection (e. 
g. an LSP) between the edge nodes 20 in the network 
10; and (b) the service bandwidth management (SBM) 

30 module 104 for managing bandwidth of the transport 
connection among the QoS and the applications. 
[0059] The TBM module 1 02 includes a transport pool 
manager 402 for establishing and managing the trans- 
port pool 1 06; a QoS mapping module 404 for assigning 

35 the QoS to each transport pool and a transport pool con- 
nection module 406 for assigning the transport connec- 
tion to the appropriate transport pool. 
[0060] The SBM module 104 includes an application 
pool manager module 408 for establishing and manag- 

40 ing application pools 116 for the QoS and the applica- 
tions, an application and QoS mapping module 410 for 
assigning application and QoS to each application pool 
and an application connection mapping module 412 for 
assigning application connections to the appropriate ap- 

45 plication pool. The module 408 creates shared pools 
200A; partitioned pools 200B (by QoS) or 200C (by ap- 
plication) or fully partitioned pools 200D by QoS and ap- 
plication. 

[0061] The apparatus 400 includes the transport CAC 
so module 300 to control admission of the transport con- 
nection and the application CAC module 350 to control 
admission of the applications over the transport connec- 
tion as discussed above based on tunnel requests. 
[0062] Although the present description of the inven- 
55 tion used MPLS as the working example hierarchical 
bandwidth management of the present invention is ap- 
plicable to any network that can benefit from hierarchal 
structure for scalability. Optical networks are one exam- 
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pie where large optical tunnels can be established be- 
tween edge nodes and bandwidth management takes 
place at the edge (i.e. the SBM module functionality). 
Another example is Virtual Private Networks (VPNs) 
where multiple customers share the same aggregate 
backbone pipes. 

[0063] In summary, hierarchical bandwidth manage- 
ment of the present invention provides the following ad- 
vantages: 

(a) increased network scalability without sacrificing 
bandwidth management efficiency and flexibility; 

(b) ability to share and/or partition bandwidth by ap- 
plication and quality of service; and 

(c) ability of customer-controlled trade-off of band- 
width guarantee (per application/QoS) and network 
efficiency (i.e. low fragmentation). 
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Claims 



1. 



4. 



A method of hierarchical bandwidth management in 
a multiservice network supporting a plurality of qual- 
ity of service levels and a plurality of applications, 
said multiservice network having a core, a plurality 
of access nodes and a plurality of edge nodes hav- 
ing connectivity with each other through the core 
with core links, said method comprising the steps of: 

(a) establishing a plurality of transport connec- 
tion tunnels between pairs of the edge nodes 
in the network; and 

(b) managing bandwidth of the transport con- 
nection tunnels among the plurality of quality of 
service levels and the plurality of applications. 

The method of claim 1, wherein step (a) includes 
the steps of: 

(a1) establishing at least one transport pool; 
(a2) assigning the plurality of quality of service 
levels to the least one transport pool; and 
(a3) assigning at least one transport pool to the 
plurality of transport connections. 

The method of claim 2, wherein the at least one 
transport pool is shared among the plurality of qual- 
ity of service levels. 

The method of claim 2, wherein each of the core 
links is partitioned into multiple transport pools with 
a single quality of service level selected from the 
plurality of quality of service levels being assigned 
to each pool. 

The method of claim 2, wherein each of the core 
links is partitioned into multiple transport pools with 
groups quality of service levels selected from the 
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30 



35 



40 



45 



50 



55 



plurality of quality of service levels. 

6. The method of claim 3, wherein the plurality of 
transport connections are label switched paths and 
where the plurality of quality of service levels are 
selected from the group consisting of EF, AF1 , AF2 
and BE. 

7. The method of claim 1 , wherein step (b) includes 
the steps of: 

(b1) establishing at least one application pool; 
and 

(b2) assigning the plurality of applications to the 
least one application pool. 

8. The method of claim 7, wherein bandwidth of the 
transport connection tunnels is assigned to one of 
the at least one application pool for sharing among 
the plurality of applications. 

9. The method of claim 7, wherein bandwidth of the 
transport connection tunnels is assigned to multiple 
of the at least one application pool for each the plu- 
rality of applications. 

10. The method of claim 7, wherein bandwidth of the 
transport connection tunnels is assigned to multiple 
of the at least one application pool for sharing 
among groups of the plurality of applications. 

11. The method of claims 8, wherein the plurality of 
transport connections are label switched paths and 
where the plurality of applications are selected from 
the group consisting of ATM, FR. MPLS, and IP. 

12. The method of claim 7, further comprising: 

(c) advising the access nodes of the network of 
changes to the least one application pool; and 

(d) if bandwidth is available in the core, revising 
the assignment of the plurality of applications 
to the at least one application pool established 
at step (b2). 

1 3. A method of hierarchical bandwidth management in 
a multiservice network supporting a plurality of qual- 
ity of service levels and a plurality of applications, 
said multiservice network having a core, a plurality 
of access nodes and a plurality of edge nodes hav- 
ing connectivity with each other through the core, 
said method comprising the steps of: 

(a) establishing a transport connection tunnel 
between pairs of the edge nodes in the network; 
and 

(b) managing bandwidth of the transport con- 
nection tunnel among the plurality of quality of 
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service levels and the plurality of applications. 

14. The method of claim 13, wherein step (a) includes 
the steps of: 

5 

(a1) establishing a transport pool; 

(a2) assigning the plurality of quality of service 

levels to the transport pool; and 

(a3) assigning the transport connection tunnel 

to a transport pool. 10 

15. The method of claims 14, wherein the transport con- 
nection is a label switched path and where the plu- 
rality of quality of service levels are selected from 
the group consisting of EF, AF1 , AF2 and BE. is 

16. The method of claim 13, wherein step (b) includes 
the step of: 

(b1) establishing a shared application pool for 20 
the plurality of quality of service levels and the 
plurality of applications. 

17. The method of claim 13, wherein step (b) includes 
the steps of: 25 

(b1 ) establishing multiple application pools par- 
titioned by quality of service; and 
(b2) assigning a percentile value of total trans- 
port connection tunnel bandwidth to each qual- 30 
ity of service. 

18. The method of claim 13, wherein step (b) includes 
the steps of: 

35 

(b1 ) establishing multiple application pools par- 
titioned by application; and 
(b2) assigning a percentile value of total trans- 
port connection tunnel bandwidth to each ap- 
plication. 40 

19. The method of claim 13, wherein step (b) includes 
the steps of: 

(b1 ) establishing multiple application pools par- <s 
titioned by quality of service level and by appli- 
cation; and 

(b2) assigning a percentile value of total trans- 
port connection tunnel bandwidth to each qual- 
ity of service level and application. so 

20. An apparatus for hierarchical bandwidth manage- 
ment in a multiservice network supporting a plurality 
of quality of service levels and a plurality of appli- 
cations, said multiservice network having a core, a 55 
plurality of access nodes and a plurality of edge 
nodes having connectivity with each other through 
the core, said apparatus comprising: 



(a) a transport bandwidth management (TBM) 
module for establishing a transport connection 
tunnel between pairs of the edge nodes in the 
network; and 

(b) a service bandwidth management (SBM) 
module communicatively coupled to the TBM 
module for establishing application connec- 
tions for managing bandwidth of the transport 
connection tunnel among the plurality of quality 
of service levels and the plurality of applica- 
tions. 

21. The apparatus of claim 20, wherein the TBM mod- 
ule includes: 

a module for establishing and managing a 
transport pool; 

a module for assigning the plurality of quality of 
service levels to the transport pool; and 
a module for assigning the transport connection 
tunnel to the transport pool. 

22. The apparatus of claim 20, wherein the SBM mod- 
ule includes: 

a module for establishing and managing a plu- 
rality of application pools; 
a module for assigning the plurality of applica- 
tions at the plurality of quality of service levels 
to each of the plurality of application pools; and 
a module for assigning the application connec- 
tions to the plurality of application pools. 

23. The apparatus of claim 20, wherein the SBM mod- 
ule includes: 

a module for establishing multiple application 
pools partitioned by quality of service; and 
a module for assigning a percentile value of to- 
tal transport connection tunnel bandwidth to 
each quality of service. 

24. The apparatus of claim 20, wherein the SBM mod- 
ule includes: 

a module for establishing multiple application 
pools partitioned by application; and 
a module for assigning a percentile value of to- 
tal transport connection tunnel bandwidth to 
each application. 

25. The apparatus of claim 20, wherein the SBM mod- 
ule includes: 

a module for establishing multiple application 
pools partitioned by quality of service level and 
by application; and 

a module for assigning a percentile value of to- 
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tal transport connection tunnel bandwidth to 
each quality of service level and application. 

26. The apparatus of claim 25, further comprising a 
transport connection admission control module to 
control admission of the transport connection and 
an application connection admission control mod- 
ule to control admission of the plurality of applica- 
tions over the transport connection. 

27. The apparatus of claim 20, wherein the apparatus 
resides in the plurality of edge nodes. 



28. An edge node for hierarchical bandwidth manage- 
ment in a multiservice network supporting a plurality f 5 
of quality of service levels and a plurality of appli- 
cations, said multiservice network having a core 
and a plurality of access nodes where a plurality of 
the edge nodes having connectivity with each other 
through the core, the edge node including the ap- 20 
paratus of claim 20. 

29. A computer program product for hierarchical band- 
width management in a multiservice network sup- 
porting a plurality of service categories and a plu- 25 
rality of applications, said multiservice network hav- 
ing a core, a plurality of access nodes and a plurality 

of edge nodes having connectivity with each other 
through the core, said computer program product 
comprising: 30 

(a) a computer readable medium; 

(b) a transport bandwidth management (TBM) 
module for establishing a transport connection 
tunnel between pairs of the edge nodes in the 35 
network; and 

(c) a service bandwidth management (SBM) 
module communicatively coupled to the TBM 
module for managing bandwidth of the trans- 
port connection tunnel among the plurality of *o 
quality of service levels and the plurality of ap- 
plications. 



30. The computer program product of claim 29, wherein 
the TBM module includes: 



45 



a module for establishing and managing a 
transport pool; 

a module for assigning the plurality of quality of 
service levels to the transport pool; and 50 
a module for assigning the transport connection 
tunnel to the transport pool. 

31 . The computer program product of claim 29, wherein 
the SBM module includes: 55 

a module for establishing and managing a plu- 
rality of application pools; 



a module for assigning the plurality of applica- 
tions at the plurality of quality of service levels 
to each of the plurality of application pools; and 
a module for assigning the application connec- 
tion to the plurality of application pools. 

32. The computer program product of claim 29, wherein 
the SBM module includes: 

a module for establishing multiple application 
pools partitioned by quality of service; and 
a module for assigning a percentile value of to- 
tal transport connection tunnel bandwidth to 
each quality of service. 

33. The computer program product of claim 29, wherein 
the SBM module includes: 

a module for establishing multiple application 
pools partitioned by application; and 
a module for assigning a percentile value of to- 
tal transport connection tunnel bandwidth to 
each application. 

34. The computer program product of claim 29, wherein 
the SBM module includes: 

a module for establishing multiple application 
pools partitioned by quality of service level and 
by application; and 

a module for assigning a percentile value of to- 
tal transport connection tunnel bandwidth to 
each quality of service level and application. 

35. The computer program product of claim 34, further 
comprising a transport connection admission con- 
trol module to control admission of the transport 
connection and an application connection admis- 
sion control module to control admission of the plu- 
rality of applications over the transport connection. 

36. A method of hierarchical bandwidth management in 
a multiservice network supporting a plurality of qual- 
ity of service levels and a plurality of applications, 
said multiservice network having a core, a plurality 
of access nodes and a plurality of edge nodes for 
establishing user connections, said edge nodes 
having connectivity with each other through the 
core, said method comprising the steps of: 

(a) establishing a plurality of transport connec- 
tion tunnels between pairs of the edge nodes 
in the network at a transport layer; 

(b) managing bandwidth of the transport con- 
nection tunnels at an application layer; 

(c) controlling admission of the plurality of 
transport connection tunnels at the transport 
layer; and 
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(d) controlling admission of the user connec- 
tions belonging to the plurality of applications 
at the plurality of quality of service levels. 



37. The method of claim 36, wherein step (b) includes 5 
the step of allocating bandwidth of the transport 
connection tunnels among the plurality applica- 
tions. 

38. The method of claim 37, wherein the plurality of ap- to 
plications are selected from the group consisting of 
ATM, MPLS, FR and IP. 

39. The method of claim 36, wherein step (b) includes 
the step of allocating bandwidth of the transport 15 
connection tunnels among the plurality of quality of 
service levels. 

40. The method of claim 39, wherein the plurality of 
quality of service levels are selected from the group 20 
consisting of IP based parameters: EF, AF1, AF2 
and BE at the transport layer. 

41. The method of claim 39, wherein the plurality of 
quality of service levels are selected from the group 25 
consisting of ATM based parameters: CBR, VBR-rt, 
VBR-nrt and UBR at the application layer. 

42. The method of claim 39, wherein step (b) includes 
the step of allocating bandwidth of the transport 30 
connection tunnels among the plurality of applica- 
tions at the plurality of quality of service levels. 

43. The method of claim 39, further comprising the step 

of defining priority for each of the plurality of appli- 35 
cations at each of the quality of service levels. 

44. The method of claim 43, further comprising the step 
of bumping a selected one of said plurality of appli- 
cations from a given priority. 40 

45. The method of claim 39, steps (c) and (d) including 
converting protocol dependent application parame- 
ters to generic bandwidth requirements. 

45 
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